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Abstract. This short communication shows that in some cases scalar elliptic 
finite element matrices cannot be approximated well by an SDD matrix. We 

{~S> also give a theoretical analysis of a simple heuristic method for approximating 

^_«) an element by an SDD matrix. 
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1. Introduction 

C*") In [2J we study the theoretical and practical aspects of approximation scalar 

elliptic finite element matrices by SDD matrices. The core task in the process is 
element-by-element approximation of reasonably small element matrices. This short 
communication shows that in some cases element matrices cannot be approximated 
well by an SDD matrix. We also give a theoretical analysis of a simple heuristic 
method for approximating an element by an SDD matrix. 
i ^ i There are several different definition of condition numbers and generalized con- 

dition number. We give here the definition that is suitable for analyzing precondi- 
tioners, which is the ultimate goal of our approximation. 

£■ — Definition 1. Given two real symmetric positive scmidcfinitc matrices A and B 

with the same null space S, a finite generalized eigenvalue A of (A, B) is a scalar 
satisfying Ax = XBx for some x (I §. The generalized finite spectrum A(A, B) is the 
set of finite generalized eigenvalues of (A, B), and the generalized condition number 

^ k(A,B) is 

, . „. maxA(A, 5) 

0\ k(A, b) = . : . 

^ v ' mmA(AB) 

We also define the condition number k(A) = n(A, P±§) of a single matrix A with 
null-space S, where P±§ is the orthogonal projector onto the subspace orthogonal 
to S. This scalar is the ratio between the maximal eigenvalue and the minimal 
nonzero eigenvalue of A. 
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2. APPROXIMABILITY OF ILL-CONDITIONED MATRICES 

2.1. Approximability vs. Ill-conditioning. In [2J we show that if A is well- 
conditioned it is always well-approximable. The question is whether this sufficient 
condition is also a necessary one. When A is ill conditioned, there may or may 
not be an SDD matrix B that approximates it well; the following two examples 
demonstrate both cases. 

Example 2.13 in [2j presents an SDD matrix that is ill conditioned. This is an 
obvious example of an ill-conditioned but well-approximable matrix. First, we show 
an example of a non-SDD (and not close to SDD) ill-conditioned matrix which is still 
well-approximable. We 
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Example 2. ([!]) Let 
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for some small e > 0. This matrix is the element matrix for a quadratic triangular 
element with nodes (0,0), (0,e) and (1,0), quadrature points are midpoints of the 
edges with equal weights, and material constant 9=1. 

This matrix is clearly ill conditioned since the maximum ratio between its diag- 
onal elements is proportional to 1/e 2 . 

To show that this matrix is approximable consider the following SDD matrix: 



A: 



We will show that k(A,A + ) < 2. Define the matrix 
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Notice that A = A + — A-. Since A_ is symmetric positive definite this implies 
that Xmax(A,A + ) < 1. We will show that X m i n (A,A + ) > 1/2. This condition is 
equivalent to the condition that \ mllx (A + ,A) < 2, which is the equivalent to the 
condition that 2 A — A + is positive semidefinite. According to Lemma 3.3 in [5] 
it is enough to prove that a(A_,A + ) < \. This can easily be achieved by path 
embedding where we embed the (1,2) edge in A- with the path(l,4) — > (4,2) and 
the edge (1,3) with the path (1,6) — > (6,3). Congestion is 1 because no edge is 
reused and for both paths the dilation is \. 



2.2. Pathological Inapproximability. The question that we answer in this sub- 
section is whether there exist inapproximable elements. By the last section, if there 
exist such an inapproximable element matrix, it should be ill conditioned. The 
following example show that such a matrix indeed exist. 

Example 3. ( 5 ) The following matrix is an clement matrix for an isosceles triangle 
with two tiny angles and one that is almost n, with nodes at (0, 0), (1, 0), and (1/2, e) 
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for some small e > 0. The element matrix is 



A = 



1 

27 



1 



This matrix has rank 2 and null vector [ill]. We now show that for any SDD 
matrix B with the same null space, k(A,B) > e~ 2 /4. Let v = [l —1 0] T and 
u = [l 1 — 2] T ; both are orthogonal to [l 1 l] T . We have v T Av = 2e and 
u T Au = 4.5e _1 . Therefore, 

k(A,B) = 



x 1 Ax 



max 



max 



> 



x T Bx 

±nu\l{A) X T Bx " xXnutt(A) X T Ax 

u T Au v T Bv 

^ 

u T Bu v T Av 
4.5 v T Bv 



2e 2 u T Bu 



We denote the entries of B by 



B = 



bi2 + b\3 
-bi2 

-&13 



-&12 

bi2 + b 2 3 

~&23 



-613 
-&23 

6 13 + 6 



23 



where the 6ij's are non-negative. Furthermore, at least two of the fr^ 's must be 
positive, otherwise B will have rank 1 or 0, not rank 2. In particular, 613 + 623 > 0. 
This gives 

v T Bv _ Ab 12 + b 13 + b 23 _ 46 12 1 > 1 

u T Bu ~ 9&13 + 96 2 3 _ 9fei 3 + 96 2 3 9 ~9' 



Therefore, n(A, B) > e /4, which can be arbitrarily large. 



3. A Simple Heuristic for Symmetric Diagonally-Dominant 

Approximations 

The following definition presents a heuristic for SDD approximation. 

Definition 4. ([2]) Let A be a symmetric positive (semi) definite matrix. We define 
A + to be the SDD matrix defined by 




i =/= j and ay < 
i =/= j and > 
i =3 ■ 



Clearly, A + is SDD. We show that if A is well conditioned this simple heuristic 
yields a fairly good approximation. 

Lemma 5. Let A be an SPSD n e -by-n e matrix with null(A) = span[\ . . . 1] T . 

Then null(A + ) = span[\ . . . l] T , and n(A,A + ) < y / t^Tk(A). Moreover, if there exist 
a constant c and an index i such that ||A|| inf < cAu , then k(A, A + ) < ck(A). 
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Proof. We first show that null(A) = null(A + ). Let A_ = A + - A. The matrix A. 
is symmetric and contains only nonpositive off diagonals, and 



A_[l ... 1] T = A + [l ... 1] T -A[1 



ll T = 0. 



Therefore, A- is an SDD matrix. Since SDD matrices are also SPSD, for all 



(3.1) < x T Ax = x T A + x ~ x T A^x < x T A + x . 

Therefore, null(^4 + ) C null(A). The equality of these linear spaces follows from the 

equation A + [l ... l] T = 0. 

By equation 3.1 for all x ^ null(^4 + ), x T Ax/x T A + x < 1. This shows that 
maxA(A,A + ) < 1- 

We now bound maxA(A + , A) from above. For every vector x ^ null(A), 

x T A + x x T A + x/x T x maxA(A + ) 
x 7 'Ax x T Ax/x T x ~ minA(A) 

Therefore, it is is sufficient to show that maxA(A + ) < 6>maxA(yl) for some positive 
6 in order to show that maxA{A + ,A) < 9n(A) and k(A,A + ) < 6n(A). 

Since A [l ... l] T = 0, A is SPSD, and assuming n e > 1, for every i, 
\A ii \=A ii = ^2\(A + ) ij \-J2\{A-) i 



Therefore, since A + [l 

E I A 



(3.2) 



. l] T = 0, for every i, 
= {A + ) ii + Y,\{A + ) i 

= EKU • 



By the definitions of the 1-norm and the inf-norm, and the fact that A + is symmct- 
ric, \\A + \\ X = \\A+\\. mV Moreover, by ft Corollary 2.3.2], ||A + || 2 < VP+lli lU+Lr 
Therefore, 



(3.3) 



\A + \\ 2 < \\A + \\ ini 



= max 



EN* 

3 

Ei A «i 



inf ' 



where the second equality is due to equation 3.2 Therefore, by [4, Equation 2.3.11] 

\\A + \\ 2 <\\A\\ inf <V^e\\A\\ 2 . 
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Since A + and A are both symmetric, maxA(A + ) — ||-A+|| 2 and maxA(A) = ||A|| 2 . 
Therefore, maxA(^4 + ) < ^Jn~ e max A( A) . This shows that k(A,A + ) < ^/n^K(A) 
and concludes the proof of the first part of the lemma. 

We now assume that there exist a constant c and an index i, such that ||A|| inf < 
cAjj. By equation 
we have that \\A+ 

that in this case k(A, A + ) < ck(A) and concludes the proof of the lemma. 



3.3 we have that ||-A+|| 2 < cAu. Since for every i, An < \\A\\ 2 , 
| 2 < c||A|| 2 . Therefore, maxA(A + ) < cmaxA(i). This shows 
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The following example shows that if A is not well-conditioned, this heuristic may 
generate a bad approximation. 

Example 6. ([1J) Let < e < 1, and let M > 



A = 



This matrix is symmetric semidefinite with rank 3 and null vector [l 1 1 l] . 
We show that for small e, A is ill conditioned, with condition number larger than 
8e- 2 . Let 
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and 174 



be an orthonormal basis for 



I 4 . We have 

qlAq t = 

q 2 Aq 2 = 2M 

q%Aq 3 = 2M + e 

qjAqi = e . 

Therefore, k(A) > 2M/e > 8e" 2 . We show that the matrix A + is a poor approxi- 
mation of A. 

qfA +qi = 

q%A + q 2 = 2M 

qjA + q z = 2M + 1 

qjA+q 4 = 1 . 

Therefore, 



k{A,A + ) > ^1 
On the other hand, the SDD matrix 



2M+ 1 



B = 



e + M -e — M 

-e e + Af -M 

-M e + M -e 

-M -e e + M 
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is a good approximation of A, with k(A, B) < 9. This bound follows from a simple 
path-embedding arguments [5] , which shows that 3 A — B and 3B — A are positive 
semidefinite. The quantitative parts of these arguments rest on the inequalities 



111 1 

< 



2M 2M 3 - e - 3 - 4e 
and 

111 1 

2M + 2M + l + 2e < 1 - 3e 

which hold for small e. 
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